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resolution instrument have dimensions, Ax and Ay, with reference at x* y©. The 
following definition of symbols applies hereinafter: 

x, y : the coordinates of the imaged surface; positive real numbers. 

Ax, Ay : pixel dimensions of the higher resolution image; positive real numbers. 

x 0 , y u : the lower left corner of the imaged surface (the zero point of the 
coordinate system). 

xj » x D + iAx and yj = y„ + jAy refer to the i, j pixels of higher resolution image. 
M, N refers to the higher resolution instrument pixel,elements. 
m, n refers to the lower resolution instrument pixels, 
(i j) refers to the higher resolution image, 
(i', j') are the labels for the lower resolution instrument 
R„ R y are positive numbers defining the resolution of the higher resolution 
instrument along the two coordinates x, y. 


Using the above, the pixels in the higher resolution instrument are identified as follows: 

(1) (ijJ.i-O.L — M-1J-0 V l.-N-l 

For the lower resolution instrument, the pixels arc identified as: 

(2) 


(i'j') f i'-<U-- — -1J'-<U---1 

m n. 


Where — and — are the ratios between the coarser and finer resolution cells. 
m n 

With the identification of the geometric relationship between the two-dimensional pixel 
array of the higher resolution instrument and imaging surface, the complex value of the V- 


lmage is: 


Cy 4 £ £ J h (x - xi, y-yj) a (x,y)exp (te(x,y)) dxdy (higher resolution) 

The image intensity is: ^ 
lij= |Cy| (higher resolution) 




(3) The expected value of image intensity is: 
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</„ > a ^ff) I h (x-x* - i 2 (t a ^ X,y ^)dxdy (higher resolution) 

From equation (2), the coordinates of the pixels of the lower resolution instrument are 
identified; which leads to: 

(4) x ,'=Xo+ (m " 1)Ar -fi'mAx 


(5) Yfm^+iSlS^^nAy 



These two equations assume that the tao-hfiages are co-registered. From this, the 
expected intensity of the low^r^solution instrument is obtained: 

(6) <//•/> i T T ) I h ' (x-*\ y-y/) | 2 (W'ffl*) dxdy 

The two images ofthe same scene are statistically independent, and the relative variance 
of the two images are: 


(7) v. 


Higher Resolution [mage (independent of i j) 


Lower Resolution Image (independent of i' j 1 ) 


The square of the absolute value of the impulse responses of the two instruments arc: 
/ 

(9) |b(x^l 2 ° 7&ty for|x|£RxJy|£Ry Higher Resolution Instrument 


(10) and \h\x,y)\ 2 * mn |h(x/m, y/m)| z Lower Resolution Instrument 


/ 


By combining (3). (6) J9H«d-(4.0 

-IE 


result is 


(u, l, ej ) 



. Z '.A, 


That is, the expected intensity of the lower resolution image i$ the local average of the 
higher resolution image. The fusion of the two image intensities is obtained as the 
solution to the following minimization problem: 
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And: _ 
(14) Xy SO 

Where, in (13) 5=0. l~M/m-l,j=0, 1— N/n-1 - and in (14) M>,1. -M-l and j =0,1, ~N- 
l 

Equation (13) enforces the condition that the expected image intensity of the coarser 
resolution instrument must be the appropriate weighted average (with weights 7 a«d 

~ of the coarser resolution estimated from the two images. Equation (14) indicates 

that the intensity is always positive. Tbe minimization problem with MN independent 
variables can be decomposed in MN/mn independent variables. The sub-problems are 
labeled: i' = 0, 1, — M/m- l.j'-0, 1,— Nto-l. The (i*,j')th sub-problem is the 
following: — (ij-JLlm-A (J-*)#-J 

us) =1 z 1 Z, 2, 

Subject to the constraints of ( 1 3) and 
(16) Xwao 

Where, in (16) : k = i'm, i'm + 1 , ~-(i' + 1) m - 1 

l^'nJ'n+l-Oj'+l) -1 
By thusly performing a fusion of the images as taught by Costantini et al* a better match 
between the sensors can be achieved. 


9 

PA(£ 1 103 1 RCVD AT 5/2612005 10:50:25 AM [Eastern Daylight Time) 1 SVfcUSPTO-EFXRF-IW 1 DNIS:8729306 1 C$ID:256 876 9438 ' DURATION (iniiK$):0!W8 


